Random Symmetry Breaking and Freezing in Chaotic Networks 
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Parameter space of a driven damped oscillator in a double well potential presents either a chaotic 
trajectory with sign oscillating amplitude or a non-chaotic trajectory with a fixed sign amplitude. 
A network of such delay coupled damped oscillators is shown to present chaotic dynamics while the 
amplitude sign of each damped oscillator is randomly frozen. This phenomenon of random broken 
global symmetry of the network simultaneously with random freezing of each degree of freedom is 
accompanied by the existence of exponentially many randomly frozen chaotic attractors with the 
size of the network. Results are exemplified by a network of modified DufBng oscillators with infinite 
range pseudo-inverse delayed interactions. 
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Chaos and spontaneous symmetry breaking seem to ex- 
clude themselves. A chaotic system explores its complete 
available phase space [l| , hence multiple attractors occur 
for very special systems, only In particular, when a 
nonlinear system has a plus / minus symmetry, any initial 
state with a positive amplitude has a twin with a cor- 
responding negative amplitude. Any chaotic trajectory 
will visit positive and negative amplitudes with the same 
frequency unless the dynamics prohibits switching of the 
sign. The average sign of the amplitude is zero and the 
chaotic system will not break the plus/minus symmetry. 
On the other hand, a non-chaotic system can break this 
symmetry - an example is a particle which moves in a 
double well potential with friction. 

On a level of a network composed of delayed coupled 
chaotic units with plus/minus symmetry, it has recently 
been shown Q that many chaotic attractors can be found 
simultaneously with frozen sign of the amplitude of each 
chaotic unit. The number of such chaotic attractors 
scales exponentially with the size of the network. How- 
ever, for each isolated chaotic unit the sign of its ampli- 
tude is fixed by the initial condition, hence this network 
does not spontaneously break the plus/minus symmetry. 

In this letter, we consider a network of nonlinear 
units with plus/minus symmetry. Each isolated unit has 
chaotic trajectories which do not break this symmetry - 
the sign of the amplitudes of a chaotic trajectory is al- 
ternating. We show, however, that in a network of such 
mutually coupled chaotic units the symmetry of each unit 
can be broken, spontaneously. The sign of the amplitude 
of each unit is frozen while the entire network is still 
chaotic. Furthermore, when the coupling is random or 
constructed from many patterns, there exists an expo- 
nentially large number of such chaotic states with frozen 
amplitude signs. 

In the framework of statistical mechanics a randomly 
broken symmetry was found in spin-glass (SG) systems. 
Each isolated spin is characterized by an alternating sign, 
stochastically driven by temperature. A network of cou- 
pled spins with random coupling strengths, however, un- 
dergoes a phase transition, where the low temperature 
phase is characterized by a randomly frozen expectation 



value of each spin [^-|6| . The goal of this letter is to show 
that a similar phenomenon exists in a network where a 
discrete spin is replaced by a chaotic unit with alternat- 
ing sign of its amplitude. 

Results are exemplified with a network of delayed cou- 
pled modified Duffing oscillators 01 where the interac- 
tions are of the type of the pseudo-inverse model @, Q . 
This chaotic network functions also as an associative 
memory with large basin of attractions surrounded by 
chaotic attractors. The number of the pre-defined basins 
of attractions, the stored patterns, scale linearly with the 
size N of the network whereas the total number of chaotic 
attractors increases exponentially with N. Note that a 
network of chaotic maps with non-extensive logarithmic 
number of attractors was observed [l0| for uniform fer- 
romagnetic interactions without delays. 

The examined chaotic unit is a driven damped oscilla- 
tor in a double well potential and is given explicitly by 
the Duffing equation 

X ^ -5x~/3x-ax^+^cos{u;t) (a, (5 > 0, /3 < 0) (1) 

which is known to be a simple chaotic model The 
nature of the driving force in Eq. ([T|) breaks the inversion 
symmetry (x — >■ —x) of the chaotic dynamics. In order 
to examine the possibility of broken symmetry on the 
network level where each chaotic unit is characterized by 
an alternating sign we introduce the following modified 
Duffing equation (MDE) 

X ~ —6x — /3a- — ax^ + ^ cos{ijjt)sgn{x) — J-{x) (2) 

where sgn is the signum function. The dynamics of MDE 
is characterized by alternating sign amplitude. Fig. [I^a), 
and is also characterized by chaotic behavior. Fig. [H^b). 
Specifically, the potential of the (modified) Duffing oscil- 
lator has stable points at x = -ii\J^^ and an unstable 
point at x = 0. When the driving force is too weak the 
oscillator will stay in one of the two wells while for strong 
driving force there are transitions from one well to the 
other. 

Introducing a delayed self-feedback into the system 



±{t) = (1 - e)F{x{t)) + ex{t - r) 



(3) 
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FIG. 1: (a) A typical trajectory of a single MDE without 
self-feedback with a = l,/3 = —1,S — 0.2, lj = 1. (b) Diver- 
gence of two nearby initial conditions of a single MDE with- 
out self-feedback. The divergence indicates chaotic behavior 
for both driving force amplitudes 7 = 0.3 and 7 = 1. (c) 
Typical trajectories of a single MDE with self-feedback with 
a = 1, P — —1,7 = 1,(5 = 0.2,0; = 1. (d) Divergence of two 
nearby initial conditions as in (c). In the weak coupling limit 
(e = 0.1) the trajectory is chaotic but not frozen, whereas in 
the strong coupling limit (e = 0.9) the trajectory is frozen 
but not chaotic. Although the stable points of the Duffing 
potential are at x = ±1 the trajectory freezes at a; « 3, indi- 
cating the freezing is not due to settling at the bottom of the 
potential well. 



the trajectory may settle down after some transient time 
into a fixed sign amplitude. There are mainly two dynam- 
ical regions characterized by the strength of the driving 
force. For a weak driving force, e.g. 7 ~ 0.1 in Fig. 
[IJc,d), the amplitude is alternating and the trajectory is 
chaotic, while for a strong driving force, e.g. 7 = 0.9, 
the sign of the amplitude is fixed and the dynamics is 
non-chaotic. Quantitatively, the freezing of a trajectory 
is defined as 



(4) 



where (•) stands for time averaging. For a uniform dis- 
tribution with a given sign one can easily verify that 
(j) = 0.75 and for a complete freezing (f) = 1. Hence, 
freezing is characterized by G [0.75, 1]. 

The probability of finding a positive Lyapunov expo- 
nent (A > 0) and the probability of freezing (0 > 0.8) in 
a MDE, Eq. ([31), as a function of the feedback strength 
e are depicted in Fig. [DJa). In the weak coupling region 



FIG. 2: (a) Probability for a chaotic trajectory (A > 0) 
and the probability of freezing {(j) > 0.8) as a function of e 
for a single MDE with feedback, Eq. with a = 1,P = 

-1, 7 = 1, (5 = 0.2, a; = 1 and T = 0.2 . (b) Probability for the 
coexistence of chaotic trajectory and freezing as a function of 
e. Parameters are: a = l,/3 = —1,7 = 1,6 = 0.2, lj — 1 and 
r = 0.2 . 



each MDE, Eq. ([3]), is chaotic and is not frozen while in 
the strong coupling region freezing emerges but chaotic 
dynamics disappear. There is a very limited intermedi- 
ate region where both freezing and chaos can be found 
simultaneously with very low probability. 

We introduce now a network of delayed coupled MDE 
units in which the above-mentioned postulate is violated. 
The fully connected network is defined by the interaction 
matrix W , which takes the form 



1 



N 



(5) 



where = ±1 with equal probability are the P stored 
patterns = 1 . . . P, i = 1 • • • N) and TV is the size of the 
network. In the prototypical model, units of the network 
arc Ising spins {Si = ±1) and the energy of the network 
is given by the Hamiltonian 



1 " 



(6) 



The P patterns are minima of the Hamiltonian, Eq. ([6]) , 
and the pseudo-inverse network operates as an associative 
memory up to P = Q , which is the upper bound of the 
capacity for Eq. ([6]) with symmetric interactions. When 
the diagonal interactions (Wu) are taken into account in 
Eq. the network does not represent a Hamiltonian 
system and the capacity is reduced to P = 0.5A^ [1]. 
Nevertheless, the stability of the patterns is maximized in 
this case, since the matrix W has P eigenvalues equal to 
1 where the patterns are the corresponding eigenvectors. 
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W^'^ = (bold letters denote vectors), and TV — P zero 
eigenvalues. 

The dynamics of MDEs, Eq. ([2]), with the pseudo- 
inverse network, Eq. ([5]), is given for unit i, for instance, 

by 



.(0 = (l-e)-F(a;,(t)) + 



N 



(7) 



where the effective average self-coupling is {{eWu)) = 
and ((•)) stands for an average over realizations of the 
interactions. The freezing of a network is defined using an 
analog of the Edwards- Anderson order parameter which 
was introduced to measure the freezing in SG systems 

m 



N 



(j){Xi) 



(8) 



where (•) stands for time averaging and N is the size 
of the network. Figure [2]^b) examines the probability to 
find simultaneously chaotic dynamics (A > 0) and freez- 
ing {qEA > 0.8) as a function of the coupling strength, e. 
The probability is estimated using different initial con- 
ditions for a single MDE, Eq. and over different 
initial conditions and interactions for a network of size 
iV = 100, Eq. (P. Results indicate that for a single 
MDE, independent of the coupling strength, both fea- 
ture cannot be found simultaneously, in agreement with 
Fig. [ljc,d). However for a network a transition is ob- 
served where in the strong coupling region the dynamics 
is simultaneously chaotic and each MDE is frozen. 

To examine the coexistence of freezing and chaotic dy- 
namics we first turn to examine the dynamics in the vicin- 
ity of the patterns, since we expect the pseudo-inverse 
network model to function as an associative memory. In 
contrast to Hamiltonian systems, Eq. ([5]), the patterns 
are not fixed points of the chaotic dynamics, Eq. ([7]), 
but fixed directions of the entire dynamical state of the 
network. Setting the initial condition in the direction of 
one of the patterns 



{c{t) > 0, 0<t<T) 



(9) 



and taking into account that = ±1 and W^^ = 
one can find that the dynamics of the network is reduced 
to the projection of the state of the network on the given 
pattern only 



c(<) = {l-e)Tic{t)) + ecit-T). 



(10) 



This equation describes merely the behavior of the coef- 
ficient c{t) according to Eq. The overlap 



(11) 



of the trajectory x{t) with the pattern remains unity 
and the network maintains the same direction as its ini- 
tial condition. 
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FIG. 3: Freezing of the trajectory with respect to overlaps 
with the P patterns with = 50, P = OAN (a) for a Mattis 
trajectory (b) for a SG trajectory, where each point is aver- 
aged over window of 20t and the transient time is « 5000. 
(c) Basin of attraction of a Mattis state for A*' = 20, 100 as 
a function of P. Lines are guides to the eye only. Inset - 
Lyapunov Exponent inside the Mattis and SG attractors as a 
function of the delay time r. For all panels, parameters are: 
a=l,/J = -l,7 = l,5 = 0.2, = 1 and r = 0.2 . 



When the initial condition does not have a unit overlap 
with any of the patterns, |(5^(t)| < 1, the state of the 
network can be expressed as 



(0 < i < t). 



(12) 



The dynamics in such a case cannot be written for each 
amplitude, c^{t), independently. The amplitudes are 
now coupled and as a consequence the overlaps Q^{t) 
are time dependent. Nevertheless, the model is expected 
to function as an associative memory for the embedded 
patterns, similar to other chaotic neural networks 
[111 . [T2j . Specifically, initial conditions close to patterns 
/i, for instance, are expected to converge closer to this 
pattern where \Q^\ increases. Our predefined threshold 
to identify convergence to one pattern, known as a Mattis 
state [1,3, is |(Q^)| > 0.9 as depicted in Fig. EJa). 

Quantitatively, the basin of attraction is defined as 
the minimal initial overlap with a selected pattern /i 
(and random with the other patterns), which ensures 
asymptotically |((5^)| > 0.9 with the same selected pat- 
tern. Figure |3Jc) indicates that the basin of attrac- 
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FIG. 4: Histograms of the Manhattan distances with A'^ — 
40, P = 0.4A*' (a) between difTerent sections along a trajectory 
A'*'" (b) between different trajectories A"'^. Results indicate 
a substantial gap between the maximal value of A"'° and the 
minimal value of A"''', (c) Number of SG attractors scales 
as f» 0.02exp(0.27iV) for P = 0.4iV. Error bars are smaller 
than size of symbols, (d) Relative freezing between different 
sections along a trajectory Q"'" and between different trajec- 
tories Q"''^ for iV = 40, P = 0.4iV and e = 0.9. For aU panels, 
parameters are: a = 1, P — —1,7 = 1,5 — 0.2, oj = 1 and 
r = 0.2 . 



tion decreases as P increases and it almost vanishes for 
P/N > 0.5, since the initial overlap is \{Q'')\ > 0.9. The 
basin of attraction also increases with the system size 
N, indicating that asymptotically for P/N < 0.5 it is a 
macroscopic quantity. 

For large enough N, random initial conditions, char- 
acterized by an overlap ^ 1/\/N with all patterns, are 
typically out of the basin of attraction of a Mattis state. 
The main puzzle is whether the trajectory is frozen, 
ilEA > 0.8), when there is no dominated overlap with 
any of the patterns. Figure |3l^b) indicates that this is in- 
deed the case, where after a transient time overlaps with 
all the patterns are frozen and their values are small, 
< 3/a//V. These attractors are identified as SG 
attractors characterized by the coexistence of random 
freezing of the network {qea > 0.8) and |(Q^)| < 3///V. 
However, the trajectory is still chaotic and the Lyapunov 
exponent is on the average the same as for the Mattis 
states, inset of Fig. [SJc). 

To count the number of SG chaotic attractors, we use 
the same procedure as in 0. After a transient time 
the average overlaps are calculated and the pattern with 
largest overlap is labeled P, the pattern with the second 
largest overlap as P — 1 ... and the pattern with smallest 
overlap as 1. The vector R of the P patterns with their 
ranking, is a permutation of (1, 2, . . . , P). We now define 
the Manhattan distance [l^ between two ranking vectors 



P ^ 



P" - P^ 



(13) 



One can easily verify that < A"'^ < P/2 and when 
correlations between two random ranking vectors are ne- 
glected one can find that the average Manhattan distance 
is i(P— -p). However, simulation results. Fig. SH^b), 
indicate a deviation from this expected value. The dis- 
tribution of the Manhattan distances obtained between 
different segments along one trajectory. A"'", Fig. |H[a), 
is much less than 2, indicating a substantial freezing. In 
contrast, the Manhattan distance between ranking vec- 
tors of two different frozen trajectories, after a long tran- 
sient time is much larger than 2, A"'^ 5.3 as expected 
for P = 16. This gap is the crucial quantity which enables 
us to approximate the number of SG chaotic attractors, 
as it represents a quantitative measure to distinguish be- 
tween different chaotic frozen SG attractors. Specifically, 
we first build an initial ensemble of A^o different ranking 
vectors where the Manhattan distance between any pair 
^a,/3 ^ 2. Next, starting from iVi new random initial 
conditions we find N\ new frozen trajectories. We calcu- 
late the fraction p of the new frozen trajectories which 
has already appeared in the initial ensemble, i.e. their 
Manhattan distance to one of the A^o trajectories is less 
than 2. The number of attractors is then approximated 
as 

P ' 

This estimation was done under the assumption that the 
basin of attraction of all chaotic attractors is similar, as 
was confirmed in simulations where starting from large 
random initial conditions the probability to fall into each 
attractor was similar. Using the above method we found 
that the number of chaotic attractors obeys the scaling 
^ exp(0.277V) for 7 = 1 as depicted in Fig. Ws)- 

In analogy to SG systems, the relative direction be- 
tween two TV dimensional trajectories (a and /?) is defined 
similarly to Eq. pT|) by 



Q"''^(i) 



(14) 



where < 1. Figure IH^d) indicates that the over- 

lap Q"'" between different segments along a trajectory is 
above 0.9 indicating substantial freezing, while the over- 
lap Q"'^ between different trajectories remains small as 
different trajectories are pointing in a random direction 
in the N dimensional space. (For iV = 40 in Fig. SKd) 
the expected overlap is l/-\/40 ~ 0.16 .) 

In conclusion, the emergence of symmetry breaking in 
the form of random freezing of the chaotic attractors is 
a consequence of cooperation among the entire network 
units. In contrast, single unit does not break the sym- 
metry due to its chaotic motion. We present results for a 
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specific set of parameters of the MDE, Eq. ([3|), however, 
similar quahtative behavior have been found also for dif- 
ferent driving amplitudes such as 7 = 0.3 and 7 = 0.5 
and various time delays. This phenomenon of breaking 
symmetry is not limited to pseudo-inverse types of in- 
teractions, Eq. ([SJ, and was observed in our simulations 



also for random interaction matrices. However, the scal- 
ing of the number of attractors in such networks deserves 
further research, as well as the the necessary conditions 
on the types of the interactions leading to the coexistence 
of symmetry breaking and random freezing. 
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